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A linear r egress i on i moike 1 was used ec tv i terns from a pool 

of 700 arithmetic ^jor.d problems^For presfeyitatiJon -in a computer assisted 
curriculum for elementary schoo 1 \t'udent1fe? . XKd experimental procedure . 



1. L»tep-wi«ie 1 inearregressiort an^iysi^, ^'of 
performance overav^set of 25 pr ob 1 em^**^*"^ ' 

2. Prediction of pr obab i 1 i fcy , correc t ( p(cjt 
of the 700. available problems, and 

3. Selection of the s tud ent ' s *ne x t 25 problems 
/predicted p(cj with the p(c) valuja assigned 

at the beginning of the study. 



a §tudj^*/.s 

) for ea^|h * 

by ma Vch ing ^ 
to the' student 



and .t 
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The Results showed a close match between p-redicted p(c,) 
obtained p(c) -when the experimental groups were ^valuated. 
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In tr oduci 1 or r , 

r ^ " « » ■ ,* 

i Computer As^i i s ted Instruction (CAl) holds a constant promise of 

extending the range of individualization of instruction to levels not 
possible without jthe aid of the computer. One area in which that range 
can be extended is in tailoring curriculum to specific performanc^e 
parameters of the student. 7^ ' / 

Most attempts to individualize instruction in CAI have consists 
of simply altering the path of the student through a 1 inear curr iculum 
in one (or more) of three ways: skipping i^temsi repeating items* or' 
branching to items not ^included in the linear curYiculum. More 
sophisticated approaches are possible. Several studies have.'been 
reported in wh^ich models o the student and/or ttve curriculum are usea 
to build computationdjl ly cmple)? strategics for ^molding tl^ curriculum 
to data generated in the s l^ud en t-c ur r i c u 1 um interaction, /(see Fletcher/ 

■ ■ 

1975 or Lorton &t Killami T/'TA for discussions of these approaches. ) 

The research i^eportea hert* concerns an attempt to devise a'- 
strategy- for choosing* from a large pool* a unique set Of exercises 
(arithmetic word prohlems) fo^^each student. A regression model is used 
to characterize student performance on word problems* witVi structural 
features of the word problems serving as predictor variables. Major 
emphasis in the report is (jiven'^to details of the procedure and to the 
relationship between properties of the exercises selected and th'e model 
characterizing the student The report also compares success in 
predicting student performrince using individual and group mo^dels* and 
examines the effect on pr ogress throug h * th e curriculum and other 
performance' parameters of ass i gn i nc] s t urf'en t s to work at differing 
difficulty levels. 



f he Regress i on Model 



Student performance is described using a regression model in 
uihich the Independent vaf* iab 1 es c harac t er i ze structural aspects of 
arithmetic word problems: The model is an* adap ta t i on of. one-for 

• group data used in numerous previous studies at the ^ In s t i t ut e f,or* 
Mathematical Studies in the Social Scie.nces (IMSSS) (Loftus S< Suppesi 

,1*772* Suppes# Losftus'4< Jerman# 1769). The^ regress i on model is: 



1 » h 



a . + 21, a X' 
Os . J=i js ijs 



Mihere p takes the value .04 if the first response Utj student s 

i #^ s y o 

to pro'bt^em i is incorrect# .96 if the first res-ponse Is correct. 

Definitions of the independent variables* X # are presented in 

Table 1# together With the range of each variable. Th©^ regress i on 

> 

analysis uias carried out using performance on a set of 25 uioV'd problems. 



The PS Course 



The experiment was cdnduc.ted using a CAI. course in dolviog 
arithmetic word problems. The course uia^ developed at the Institute 
for Mathematical Studies ijn the Social Sciences (IMSSS)« and Is 
described in detail in Seajr 1 e| ^ Lorton and Suppes (1973). .The student 
working, at a computer tfrminaj learns a' set of sim^e commands for 
communicating with the instructional program. He solves word problems 
by ins true ting , the computer tlL carry out tirfe appropriate ari thmetic 
operations. Thus# it is possible- to investigate a student's ^ 
problem-solving ab i 11 ty in Jependent of his computational, skill level. 
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Variable Nome . Range 



OPERS 



X STEPS 
2 



Dc Fini tion 



1-4 Number of different arithmetic operati6ns 

rerfuired to reach a solutioni using the coded 
*»cyl*ut ion string. 



1-7 Number of biiiary operations required to obtain 
ciolansiuer I using the coded solution string. 



LENGT 7-79 Number of words in the problem. Each number 
symbol (tt) counts as one uord. 



J 



VCLUE 0, 1 



ORDER 0-3 



Problem has a verbal clue (coded O) i-f 

(1) operation is + and profc^lem "ti^ uord ^ 
"together" or "a 1 togeth eri " or if 

(2) operation is - and problem has phrase "have 
left" cw' "were left* "- or iif 

(3) operation is x and problem has word "each. " 

TKe'number of adjacetTt pairs of letters in the 
fiolution string that are not in alphabetical 
order. 



ADD 



SUB 



0, 1 



0, 1 



Solution requires an addition. 
Solution requires a subtraction. 



( MUL Oil Solution req.(||^'e$ a multiplication. 

< ' DIV ' Oil Solution r^x^uires a division. 



10 



ALGER 0,1 



Prob lem statement is an algebraic 
statement I not a "story " (coded 1 ). 



Tab 1 e f . Def in i t i on of Var iab 1 es 
used in Regression Analysis. * 



y The curriculum for problem-solving (PS) course cor^sists 

op a set of introductory problems (IPRBsX^and 700 problems ordered 
by predicted difficulty level from easiest to hardest. The problem 
order was established for the course by using group performance 
data (Se'arlc* Lorton and Suppes» 1973); that ordering is referred to 
in this paper as the Gtandrjrd curriculum. The^IPRB set co^^tains. • 
14 non~-numer ical p rob 1 emt iha t provide ins true t i on -^n Communicating 
with the computer aM>d ^5 numerical problems illustrating aXyariety 
of problem types, • ^ 

Each problem in the PS. course is, coded to provide maximum 
flexibility for the curriculum driving program. Figuj/«^1 is a sample 
section of the curriculum f'ile for the PS course. Cpptaiined 'in the 
problem descr ip t iTons in this sample are examples of several key features 
or the program: generated values for the numbers within a p^roble.m» 
Te 5 1 r i c t ion s t o^1uF i cTi t h e jj e n e r a t f» d values shdul d c onf t>Vm# fcorfect 
alnswers expressed as a mathematical expr'essiom and explicit hints 
to ^be g.iven to'^the student on request. Figure 2 ^bws same of the 
problems in Figure 1 as they would be presented to the student. 

In transf.ering the problem text to the students the program 
generates num^bers at randory to replace the # signs in the problem 
text. These numbers generated to^ conform to the requirements 



in the PT^oJl^^'^ sp et i f i c a t i on labeled "Cv:" and. using the information 
in "Cs." finds the correct an^swef to the problem which the student 
may type either as a symbolic expression or as a numerical value. 



J E. 401 V < ) 

LHoui many pounds ^of 
that is tt feet by « feet by 
requires cubic inches?D 

Cv: : 2. 1 2, 1 1 2. 13 
is. 144xax/bxcXd3 I 



beans can 
# inches* 



be packed in a 
if each pound 



box 



JE. 402 V t:ii 

Ct-fouj many p ound s of- 
cover a Flouier bed tt inches 
applied to each 100 Square feet?3 
Cv: : 2 2 2. 13- 
Cs:. axb/l,^44xc/d3 I 



feVtilizer uiould be required to 
by ^>1ichesi i 1^ pounds must be 



4£. 403 V ( ) 
Clf 

^here are # 
bind in une 

Ls: 



a man 
books 
day ?1 
: 2 1 2D 
a/bxc3 ; 



can bind « sets oP books in 
in each set# houi many books 



# days and 
does the man 



!E, 404 V < ) 

CThere uier^ # telephones in Lake County in a recent 
Ife a f 7~~ff s slJifrriTg # people* and no~^lncrre than one plTone*^ dye a c h' 
p«efson# fiihat percent of the people had phones?] v , 

Lv:b.gt.a3 

Cs: a/bxl003 I ' 



!E. 405. V ( ) 

' [Mr. Larsen used # pounds oF apples to>fill basket,s 
with pounds in each. He sold the baskets fo^ * dollars \ 
\Hou) much did h e r ec e i ve . f or his apples^jS 
tv: a/em. b: 3 2 13 ^ 
Cs: a/bxc3 ' - > ^ 

Ch: Find ,qut how mbny basskets there are. 3 1 



each. 



Fi gur^^ 1 Samp le PS Course Prob 1 em File 
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PROBLEM 401 ' 

JHOW MANY POUNDS OF BEANS CAN BE PACKED IN A BOX 
THAT IS 4. 9 FEET BY 5. 9 FEET BY 7 INCHES. IF JEACH POUND 
REQUIRES 3.7 CUBIC INCHES? 

A = 4.9 • • - . 

B = 5. 9 ' 

C = "7 ' ' 

. D = , 3. 7 - 

♦ <A»12>»B*\tt\B<*BiH2) - ^ V 

E = 4163. 0 * 1 

I ■ 

F = 29141. 3 I 

♦F/D= ! 
G ~ ^ 7876. 022 ' 
WELL DONE * . 



PROBLEM 402 



HOW MANY POUNDS OF FERTILIZER WOULD BE REQUIRED TO 

COVER A FLOWER BED DO INCHES BY 75 INCHES IF 8. 5 POUNDS MUST BE 

APPLIED TO EACH 100 SQUARE FEET? 

A = 50 . • • 

B = 75 - . 

C = _ 8. 5 

' D ' • . 1 00 . 



♦Attfiy 1 44 

E =; 26. 042 



♦-EftC/lOO 

F = ' 2. 214 

»2. 214= 

G = 2. 214 

GREAT 



PROBLEM 403 : 

IF A MAN CAN BIND 70 SETS OF BOOKS IJM 7 DAYS AND 

THERE ARE 13 BOOKS IN EACH SET.. HOW MANY BOOKS DOES THE MAN 

BIND IN ONE DAY? 

A = 70 ' • • . ■ 

' D = 7 

C = 13 - . » 



»ia*70/7= 

D = . 130. 000 
NICE GOING 



Figure 2. Sample P3 Course Lesson 
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Procedure 



The full curriculum of IPRBs and 700 ordered problems uias 
used. The experimental procedure Wcjs as follous. 



1, The student worked through 'the IPRDs, When the studpnt ^ 
had worked the last problem in the set* the computer^ program presented 
again any of the 25 numerical problems for wh^ch the' ^.ppropr iate da*ta 
had not been obtainedi and then assigned the student to a one of three* 
difficulty levelsi 65 percent^ 80 percent or 95 percent. Difficulty 
level assignments wcMe made in round robin fashion so that experimental 
groups had equal numbers of students. . I" ' 



ing the 
s used 



2/ A regression equation uas calculated 
linear regression modbl. • Table 1 lists the vaf 
regression, " • 

3. The regression equation was used to predictxthe 
probability correct Fpr all 700 problems in the problem set. 
the problem set was reordered from easiest to hardes^ti u$ing 
•predicted probabilities. 




a step -wise 
in the 



then 
the 



A, A new set of 25 
by ch^oosing those problems 



problems was selected for ^he student 
whose p^redicted probability correct' (pCcl) 
was closest to the difficulty level at which the student was assigned 

* to work. Thus# for a student as^sa:^ned- to the BO" percent grou^>> ^ t^^ 

""Computer program found the first problem in the ordered set for which 
ptc3-.80<0 and# choos,ing equally from above and below* selected 25 
problems, 

5, The 25 problem i dent i'fieif s were stored in the , student 's 
history record and in subsequent lessons he worked t h ese pr ob 1 ems. 
When he. completed the problem set the analysis described Vln steps 1-4 
Cexcept for the assignment^.of difficulty level>'was repeated* 




V - Subjects 



* The experimental subjects were fourth* fi#thi and jsixth 
gr^de students enrolled in ti^e IMSSS elementary mathematicjs CAI drill^ 
and"-Rj*ac t i c e program.* Students took lesson^ at a te 1 e ty pewr i 1 1 er 
connected, t6 the IMSSS PDP~10 computer through telephone lines. 
/^ student became eligible for the PS course when his average grade 



ERIC 



• ^ i ' ' ' 

placement on the math dr i 1 l-and-prac t i c e progr,am reached 4.0, 
Thereafter* he received a PS lesson every fifth day. Thus* each student 
started the course at a different time, of y?ar# and worked a different 
number of sessi ons. Three hundred n inety-s i x student ^ worked on the PS 
course; 271 were from schools for the^ deaf in several parts-of the* 
country* the r ema i nd er Prom a primarily til at: k Ca 1 if orn ia elementary 

school. One hundred sixty-^one students completed^ the IPRP«i# and of 

» * . - ■ ■ 

these 3Q completed one or more sets of 25 problems beyond' the IPRDs: 

. ' ■<T?EGRESSION ANALYSIS PROCEDURE 



K ■ ■ 

The core of the regression analysis technique used in this - 

study is a version pP the (JCLA Biomed program BMD02R Step-wise " 

- VI' 

Linear Regression. The version u^<>ed in this study has been modified 
run on the IMSSb Pbp-lO Timesharing syrt^em^an^' was further a dap ted 

for use in this study so that the entire procedure descri'bed above was , 

r ' / 

• <^ 

automatic. That is a program was run each day wh i c h d e termitied wh ic h ^ 
students had c omp 1 e t ed e i th er the IPRB group of problems or theit?/ 
assigned group of 25 probTems, As students who had , c omp 1 e ted a block 
of problem^s were ident: fi[ed* perfyormance information was collected* 
a step-wi se regress i o1i ^lu^ run* Jthe regression equation coefficients 
were . determined and new problem's were selected and assigned on the 
basis of the predicted p<c) from the analysis: Figure 3 illustrates 
the results of this proc endure' for one stOdent through two iterati|)ns. 
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STEP-WISE REGRESSinN SUMMARY/ TABLE: for. 1. p(cy ^ (constant = -.9020) 
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FiguTO 3. Step-wise 


g r e s-s i 0 n 
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STEP-WISE REGRESSION SUMMApY TABLE: for 1. p(G) 
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Figure 3. (con't) Step— wise Regression 
Anal ysi-s for Samp le. Student 
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RESULTS 



In looking aiy the results uie are concierned with several types 
of questions. The first group of questions concerns the feasit)ility of 
the experimental procedure and t h e c harac t er i s t i c s of the resulting 
Vproblem sets. The second, group cohcerns th^ regression equations that 

Qvise during the experimental procedure* :ahd ^lastly# uie ^re interested 

• » » ' ' ■■ 

in the success of the pr^dictiotiip.. . ^ ^ * 

■ \ *• / • * ^ ^ ' ' 

Feasibility of the procedure and cli'i^lrac t er i s t i cs ,o*fr ^ t he problem set. 
The experimental procedure is i 1 lustrated^ us^ng performance 



Of a student on the IPRBs. The student worked 80 percent of the IPRBs 

^ 

correctly. The regression equation For the set of 25 problems was 

z . - -.90 - . 23X + OIX. - 1.61 X 
i , i3 ' i3.' 14 

+ 1. IBX Y. b7% . + 3. 04X> (1) 
16 f vi7 - ° 19 , ■ . ' 



'with a iiiultlple R of .69. a standard error of estimate of 1.09 
/ ■ 2^ 

and an R 6f . 48. Only 6 -of the 10 variables entered the stepwise ^ 

\ ■ ^ ' ■ ■ - 

reoTVession. ♦ 

^The cymulativo frequency distribution of predicted probability 

cgrrett obta1>ned for the 700-pfoblem set using equation l*is shown 

in Table S.'- For purposes o f,^ compar i son the figure also shows the 

distribution for the Standard curric-ulum. The Standard curriculum luas 

' ' ' < • ' ' 

ordered using the. regressi on equation 



= -1. <^ + 1. 



z = + i.aax - + . 002X " + . ibx • 

i '♦"^ il 13 14- 

•H. 97X -. 37X -. 24X./ +. 47X 
,15 16 ^1-7 <y 110 



V . ■ ■ -13 
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A. 



Number of problctns uith p < p(t) 



p(t) 
. 00 
. 05 
. 10 

. 20 
. 25 
. 30 
. 35 
40 
. 45 



Studejit Cumulative 



134 
45 
47 
66 
71 
65 
43 
13 
17 
2 



134 
17V 

226 
292 
363 

471 
404 
501 
503 
500 
507 
510 




Standard 
209 
7B 
- 41 
40 
73 
6 
f? 

0 
15 
0 > 
0 
A; 

6 • 
87 
1 

63 
35 - 
30 * 



Cumulative 

209' 

287 

328 

368 

441 

447 

459 

459 

474 

474 

474 

478 

4fl4^ 

571 

572 

635 

670 

■a 

700 



rjsquencies of problems 
at eadh t/arget probabilittj level 



the wn.,,5le. u..d for predi'cti 

ru^r predicting probabiiii. 

"CUE. A«D, SOB. DIV U 



"^ty Moan pCc] « 

level Range of pfcj 



V5 
00 



949 
. 7B7 
. 639 



723 - . 
• "^26 - , 860 



• ''^l - . 633 

T'^^'lc- 3. Character i"sti"c'rn7'~~~ 
Problem S,.f ^sritrs of 



- ...... ..... . r 

9. the .a„,e ,„.te „a.ro„ . . 

Afferent >or eacH st . " --'^Hution of ,uu .as 

' -^o.t an cas.. the „ 

- the program 

1 * 

The variable. LENGTH HiM ' 
^-egression Obtained f'! ""^^^''"•te sign 

L) constructing the sJani^/''"^^""" Performance Lii r'J'^ *''e" ' 
/ mixture, of problem*^"'f,7 ^J'rriculum in order to Ln^'L"^'' "^^^ ^" 

occurred rejuir n7%he '^^^^ ^'-^^^ of ' ^ ^^-i-** 

9. the s^me operation(s) for sol oi^T" ^ ^^^^ 



V,.!""!. Ths n.«n difference for 214 ca../,„„ 
-.0^3,_.iu a CM s,„.re v,*,e of 2.03, ,p< ooi, ^ 

, tkat the ranoe Of - ' ^""^ ^=il"ts Indicate 

■ sUc ; ■"•"^'•""-•=-—.^ent„a. ' 

-"ic.ent .to .„o. ..e .election of a set of proMejat t. ' 
^ level. ' — P^oDi.e^s at the- assigned 

The problem sets chnc, n . 
difference, f 'ndlvldual. student* sho.ed „ar»ed 

iT-ferences from one another Pnt. ' • • . ■ " 

are k ^ ' " ' °^ "-P^- i s on. pV ob 1 ems ' 

are numbered using their position' in fh - 

. .r°— ^ ^.0. the ran, : ::: 

corrlcol..., „ '. ""'"^ 'using the standardX 

numbers, contained In the assigned set for f ^ 



65 



1 

184 - 558 
1 - 6Sl 
U - 653 
103 - 486 



Diffic</lty Level 
80 

93. - 607 
44 - 413 
2 - 653 
54 - 222 



95 , 
1 - 678 
11 - 257 
40 - 265 . 
2 -r 548 



Table 4. . Range of Prob 1 em~N~ber s 
in__Ass»gned Set-Example Students' 



14.^ 

16 



Condi ti on 
At» BO 



271 ■ 

334 

36J 

iQB * 

li4 

310 

293 

329 

233 



4S7 

SOQ 

263 

100 

196 

194 

237 

304., 

343 

215 



9& 



112 

249 
367 

73 
.'1&7 

6i< 
1 1.0 
236 
200 
112 

97 
156 
280 
211 
141 

85 
U2 

6P 
118 



\ 



Table 5. Mean problem 
number for completed 

sets 



Numb er 



Var iab 1 e 



ofvcases 


Opers 


STEPS 


' LENGT 


VCLUE 


*ORDER 


ADD 


SUB 






IN 


IN 


IN. 


IN 


IN 


IN 


li ■ 


IN 


• 


IN 


- IN 


IN 


IN 




,32 


IN 


IN 




, IN 

*- 




IN 


, * IN 


IS 


IN 


IN 


IN 




IN 


IN 


IN 


3 






IN 


IN 


IN 


IN 


IN 


2 




IN 






IN 


IN 


IN 






IN 


IN 




IN 


IN 


IN 


IN 






IN 


IN 


IN 


IN 




IN 


\ 


IN 




IN 


IN 


IN 




IN 


IN 






IN 


IN- 


IN 



T.afci^lD 6. Pattern of Entry of 
VaViabl^ in the .Regression 
^ (92 of' 161 cases) 



/ 



The ranges illus4rat§d in Table 4 "indicate that the pCcDs for 



the indi vifd'^ual^ student were strikingly different from the pCc]5 for .the 
Standard curriculum, f^or example# consider the problem set at^evel 95 

that contained problems 1 and 678 oP the Standard cjurrlculum. The mean 

■ . ' ■ ^ « ■ 'i^- ' 

predicted probability correct for that set (u5in^g\the s^dent's regression 

r ' * .. \ * . ■ - 

.equation) uao . 923. ' Th e. range of predicte,^ probabil\ity correct for the-^ 

\i I* 
same problems in the Standaj'd c urr i c u 1 um '( based on ^T.oup data) tuas 

» * \ ■ 

. 887 - .odli with a mean of .276. iThe student 's performance on the set 

uas . 48. ) 

t * 

The mean' prob 1 em nt^mber f or S5 problems is shoujb for 41 students 
in Table 5. The distributions are prese^nted ?or each difficulty level. 
The variability in the problems selected iSithin each difficulty level 

. <^ ; . 

c^houjs cle^ly in the figure. The Sjprcad in mean problem numbers mthin 
each^ group, is almost the samei ann very uide,. 
<^ # Tuio conclusions emerge; th\e exp^er imental procedj^re uAs able 

to produce a problem set at the deaired predicted difficulty level 
for every studenti and^the degree ovy' 'individualization' uas ir^deed** 
highi in that the uniquely determined problem sets d if fered greatly 
from each othrer* We turn next to a consideration of th'e regressi>^ 
equations that were userf to construct i^hese problem sets. 

2. The regression equations .\ 

We'll look first at the regressioji equations characterizing 
performance on the 25 numerical IPRBs< which were completed by 161\ 
students. The IPRB set uas common for all s\^udents. It contained 
exemplars of 9 of the 10 variables; there ue^e no ALOER problems in ^the 

o 18 

ERIC . , . ■ , 



' "^^^ Performance oh IPRBs - 

Variabl-e. 

CONST OPERS STEPS ^LENGt VCI.UIZ ORDER AdD SUB KUL DIV 



Coef f 








-5. 00 


2 






-4. SO 


6 






-4. 00 


0 






-3. 50 








-3.>G0 








-2. 50 


22 






-2. 00 


30 






-1. 50 


19 


2 




-1. 00 


14 


13 


10 


-. SO 


11 


26 


45 


.00 




28 


67- 


. 50 


3 


24 


• 18 


1. 00 


2 


21 


7 


1. 50 


. 1 


15 


1 


2. 00 


1 


9 




2. 50 


2 






3. Op'. 




1 






45 
107 



0 















8 


12 






3 




5 • 








3. 




3 


4 


4 




2 


1 


1 • 


34 




2 


, 3 


1 i 


2 . 




29, 


, 7 


. 


8 


24 


' 7 


46 


26' 


5 


9 


5^' 


25 


20 


35 . 


25 


3 


32 




f 


17 


23 - 


19 


0 


35 




r 


29 


- 20 


1 


10 


1 


2 


17 


19 










8 


20 




9 






1 


25 




1 








1 



Table 7. Frequency Distribution 
for Regression Coefficients. 





1 


















Mean 


Va 1 u e 9 






Trial 


N 




• IP 


s 

O-IP 


' GP 


0-GP 


2 

• 


38 


603 


. 824 


~. 221 


. 576 


. 027 


3 


9 




. 815 


251 


. 551 


. 013 


'4 


3 




. 868 


-. 921 


. 487- 


. 059 


5 


2 


. 470 


. 869 


g99 


. 484 


-. 01'4 


.6 


1 




-. 941 


501 


. 309 


. 131 


7 


1 


. 460 


.917 


-.457 


. 536 ' 


- 97A 



0 = observed proportion correct for set of 25 problems 
IP = individually pr ed ic t etf pr pbab i 1 i ty correct for set 
GP ^ group predicted probability correct < 

1 • ■ 



Tab 1 e 8. Comparison of Performance 
withPredictions. 
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set. The resulting regression equations contained ^from 4 t*o 8 variables. 
With 9 var iab les, ^ bl2 d if ferent ^patterns of entry and non*-entry of 
variables into a regression equation are possible. The number o,f 
possible patterns with 4-8 vaViabl^s is 372. The 161 equations uiere 
not distributed un i fqrml y among the possible pl^tternsi 52 different ' 
patterns occur-red. Slightly fewer tfjan ha^f the equations (72 of the" * 
161 ) ' c onf OT^ed to one of f our •paMer^nsi which arjs illustrated in Ta^ble 
6. An additional 20 equations had the same configuration for the last 
five variables* these represent 5 ad d i t i onal pa t terns. Thus* performance 
of more, than half the students 'was characterized by equations that 
included ORDER* ADD* SUB* and MUL* and did not include DIV. 

» The distribution of regression coefficients for, 161 stj/^nts 
for per;formance on the IPRBs is. shown in Table 7. ^/ 

3. Comparison of predicted and qbsdrved .^perf oTMnance 

Thirty-eight students comp^leted at least; one" set. of 25 problems 
( trial ) bey ond the IPRB set* a total of 54 student-trials\were completed 
Figure 4 shows a scatterp^lot of observed performance by condition for 
the 54 students-trials.. Performance fell b e I ow pr ed i c t i on s fo^ 46 trials. 

The mean observed performance "^for each trial beyond the 
IPRBs is shown in Table 8. The table also includes^ the me^ti predicted 
performance- and the mean of the difference between pre^dicted and 
observed. The large negative difference b^etween observjpd and predicted 
for. each trial reflects the data-in the scatterplot/ Table 8 also 
includes group prediction data. For each set of pjjoblems selected >- 
for a student* the mean predicted probability correct was -calculated 



Percent 
Correct 



100 


* 












1 


92" 






V ^" 


88 






\ 


.84 


1 


* 


3 


oU 




* 




.76 • . 






2 


72. 






2 


68 






2 


64 


1 




3 


60 




1 


4 


56 


2 


2 


1 


4S 




J 2 ^ 




2' ■ ,■ 


3 


1 


' 44 


1 




' 3 


40 « 


1 


5 




36 


1 




. 1 


32 








28 


i C" ^ 






24 




1 




20 








16 




>• 




12 




. • A 




8 


1 






4 




r- 




i 


65 


80 


95 



* Conrfi tion 

Figure 3. Sc^'a t te^rp 1 o t of observed 
performance by condition 



using the predictions that had been used to cons true t' th e Standard 
curriculum. Thus* the 'group predicted prubability correct'' is the 
prediction for the *set of p.^rob lems' using group data. As can be seen 
in the table* the group datca were far more successful in predicting 
performance of individual students.^ For the 54 student trials \ 
Chi sqtiafve for the diifference b etuieen ot) served proportion correct 
and ind ivi dual predi c ted probability trorrect uas 60.31#.that for the 
difference betiueen observed proportion correct and group predicted 
p.r4}bab i 1 i ty correct was 4. 82. 

^ CONCLUSION ^ > * 



There is no. question about the colfnpu ta t i ona 1 complexity 

" . . \ # 

y . ■ * o \ ■ 

nor the individualization p oss i bi e^ t hr oug^^ t h e process of selecting 
groups of problems for presentation to ^tuaents based on a linear 
regression rAbdel. The procedure certainly uias feasible and produced 
both an individualization and and analysis inipossible with out the 
availability of a computer. ' 

H^uJ^ver* just as the experiment was a tour de.force for 
the ap^p 1 i cat i on 'Of well deTined models to CAI# it was also pmbigious 
in the implication -of the results to the instruct i onal process. 

aper Smith (1966)# in their dijscussion of^ model building and 
multiple' regression/ indicate that pr ed i c t i ve ^^ode 1 Si -such as that 
attempted here* canVhelp pinpoint important var\^ab 1 es and can be 
Vus^eful as variable screening deviates. Certainly on the group 
l^vel and f unct ional ly. on the individual* Sthe procedure used here 
performed those 'functi ons. / ^ ^ ^ 



Houjeveri the procedure did -no* produce parameters that tJere 
t * ' 

particularly s^ta.bJe. Moreoveri the variables eTT(tering into thfe . 

equation tended to differ from student to student and from time 1;o time. 

^here remains, much ^iDurk to be done? in order to be abld^ to sample 

enough students to produce needed s tab i 1 i t y uji (h in the model. * ^ 

The equations produced seem to lack tuo of the important qualities* 

Drapper \ Smith mention - reasonable coefficients and plausible 

equa t i ans. ' , . 

The instability can not be denied but it may be attributed to 

uieakness irr methods of measuring the criterion^ the dependant variable* 

rather than some substantial insufficiency in the method itself. 
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